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Abstract 

Dominance of Milnor attractors in high-dimensional dynamical 
systems is reviewed, with the use of globally coupled maps. From 
numerical simulations, the threshold number of degrees of freedom 
for such prevalence of Milnor attractors is suggested to be 5 ~ 10, 
which is also estimated from an argument of combinatorial explosion 
of basin boundaries. Chaotic itinerancy is revisited from the viewpoint 
of Milnor attractors. Relevance to neural networks is discussed. 

1 Introduction 

High-dimensional dynamical systems often have many attractors. Indeed, 
such systems with multiple attractors have been discussed to be relevant to 
biological memory, information processing, and differentiation of cell types [1, 
2}. There, to make connection with problems in biological networks, stabil- 
ity of attractors against external perturbation, switching among attractors 
by external operation, and spontaneous itinerancy over several lower dimen- 
sional states are important. In the present paper, we survey a universal 
aspect with regards to these points. 

One of the simplest model for such high-dimensional dynamical systems 
is globally coupled dynamical systems. In particular, "globally coupled map" 



(GCM) consisting of chaotic elements [3] has been extensively studied, as a 
simple prototype model. A standard model for such GCM is given by 

e N 

x n+1 (t) = (1 - e)f(x n (i)) + - £ f(x n (j)) (1) 

JV 3=1 

where n is a discrete time step and % is the index of an element {%— 1, 2, • • • , N 
= system size), and f(x) — 1 — arc 2 . The model is just a mean- field-theory- 
type extension of coupled map lattices (CML)[4]. 

Through the average interaction, elements are tended to oscillate syn- 
chronously, while chaotic instability leads to destruction of the coherence. 
When the former tendency wins, all elements oscillate coherently, while ele- 
ments are completely desynchronized in the limit of strong chaotic instability. 
Between these cases, elements split into clusters in which they oscillate co- 
herently. Here a cluster is defined as a set of elements in which x(i) = x(j). 
Attractors in GCM are classified by the number of synchronized clusters k 
and the number of elements for each cluster Aj. Each attractor is coded by 
the clustering condition [k, (A r i, A 2 , ■ ■ ■ , N^)]. 

As has been studied extensively, the following phases appear successively 
with the increase of nonlinearity in the system (a in the above logistic map 
case) [3]: 

(i) Coherent phase; (ii) Ordered phase; (iii) Partially ordered 
phase; (iv) Desynchronized phase: 

In (i), a completely synchronized attractor {k = 1) exists, while all attrac- 
tors consist of few {k = o(A)) clusters in (ii). In (iii), attractors with a variety 
of clusterings coexist, while most of them have many clusters (k = O(N)). 
Elements are completely desynchronized, i.e., k = N for all (typically sin- 
gle) attractors in (iv). The above clustering behaviors have universally been 
confirmed in a variety of systems (see also [5]). 

In the partially ordered (PO) phase, there are a variety of attractors with 
a different number of clusters, and a different way of partitions [N 1 , N 2 , ■ ■ ■ , A&] 
In this phase, there are a variety of partitions as attractors. As an exam- 
ple, we measured the fluctuation of the partitions, using the probability Y 
that two elements fall on the same cluster. In the PO phase, this Y value 
varies by attractors, and furthermore, the variation remains finite even in 
the limit of N — > oo [6, 7]. In other words, there is no 'typical' attractor 
in the thermodynamic limit. This is similar with the 'non- self- averaging' in 
Sherrington-Kirkpatrick model in spin glass [8]. 
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2 Attractor Strength and Milnor Attractors 



In the partially ordered (PO) phase and also in some part of ordered phase, 
there coexist a variety of attractors depending on the partition. To study 
the stability of an attractor against perturbation, we introduce the return 
probability P(cr), defined as follows[9, 10]: Take an orbit point {x(i)} of 
an attractor in an iV-dimensional phase space, and perturb the point to 
x(i) + jrndi, where rndi is a random number taken from [—1,1], uncorre- 
lated for all elements %. Check if this perturbed point returns to the original 
attractor via the original deterministic dynamics (1). By sampling over ran- 
dom perturbations and the time of the application of perturbation, the return 
probability P{a) is defined as (# of returns )/ (# of perturbation trials). As 
a simple index for robustness of an attractor, it is useful to define a c as the 
largest a such that P(cr) = 1. This index measures what we call the strength 
of an attractor. 

The strength a c gives a minimum distance between the orbit of an at- 
tractor and its basin boundary. Note that a c can be small, even if the basin 
volume is large, if the attractor is located near the basin boundary. 

In contrast with our naive expectation from the concept of an attractor, 
we have often observed 'attractors' with a c = 0, i.e., P(+0) = lim^o -P(^) < 
1. If <7 C = holds for a given state, it cannot be an "attractor" in the 
sense with asymptotic stability, since some tiny perturbations kick the or- 
bit out of the "attractor". The attractors with a c = are called Milnor 
attractors [11, 12]. In other words, Milnor attractor is defined as an attractor 
that is unstable by some perturbations of arbitrarily small size, but glob- 
ally attracts orbital points. (Originally, Milnor proposed to include all states 
with the basin of attraction of a positive Lebesgue measure, into the defi- 
nition of an attractor [11]. Accordingly, attractors by his definition include 
also the usual attractor with asymptotic stability. Here we call Milnor at- 
tractor, only if it does not belong to the latter. If this Milnor attractor is 
chaotic, the basin is considered to be riddled [13, 14]. This is the case for the 
present GCM model.) Since it is not asymptotically stable, one might, at 
first sight, think that it is rather special, and appears only at a critical point 
like the crisis in the logistic map [11]. To our surprise, the Milnor attractors 
are rather commonly observed around the border between the ordered and 
partially ordered phases in our GCM (see Fig. 2). Attractors with a c = 
often have a large basin volume, which sometimes occupy almost 100 % of 
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Figure 1: P(a) for 4 attractors for a = 1.64, and N = 10. 10000 initial condi- 
tions are randomly chosen, to make samplings. P(cr) is estimated by sampling 
over 1000 possible perturbations for each a. Plotted are robust attractors 
[32221] (<r c « .01), [3322] (a c w.0012), and Milnor attractors [31111111], 
[22111111]. The basin volume of the latter two occupies 42% and 29% of the 
phase space. 

the total phase space. 

With regards to the basin volume of Milnor attractors, the change of the 
behavior of the GCM (1) with the increase of the parameter a is summarized 
as follows: a few attractors with small numbers of clusters; increase of 
the number of attractors with stable and Milnor attractors coexisting; — > 
decrease of the number of attractors with some remaining Milnor attractors 
with large basin fractions; — > only a single or a few stable attractors with 
complete de-synchronization remain. Milnor attractors no longer exist. 

Then, why is the basin volume of Milnor attractors so large for some 
parameter regimes? To answer the question, robustness of global attraction 
is a key. Note there are a large number of attractors at the border between 
O and PO. Most of the attractors lose the stability around the parameter 
regime successively. When the stability of an attractor is lost, there appears a 
set of points in the vicinity of the attractor, that are kicked out of it through 
the temporal evolution, while the global attraction still remains. This is a 
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Figure 2: The fraction of the basin ratio of Milnor attractors, plotted as a 
function of a, for N = 10, 50, 100 

reason why fragile attractors are dominant around the PO phase. In Fig. 2, 
we have plotted the sum of basin volume rates for all the Milnor attractors. 
Dominance of Milnor (fragile) attractors is clearly seen. 

Attractors are often near the crisis point and lose or gain the stability at 
many parameter values in the PO phase. Furthermore, the stability of an 
attractor often shows sensitive dependence on the parameter. It is interesting 
to see how P(+0) and basin volume change with the parameter a, when an 
attractor loses asymptotic stability. As shown in [15], the basin volume of an 
attractor often has a peak when the it loses the stability and then decreases 
slowly as P(+0) gets smaller than unity, where the attractor becomes a 
Milnor one. Although the local attraction gets weaker as P(+0) is smaller 
than 1, the global attraction remains. It is also noted that if P(+0) equals 1 
or not often sensitively depends on the parameter a, while the basin volume 
shows smooth dependence on the parameter. The basin volume reflects on 
global attraction, while the P(+0) depends on local structure in the phase 
space with regards to collision of an attractor and its basin boundary. This 
is the reason why the former has a smooth dependence of the parameter, in 
contrast to the latter. 



Coexistence of attractors with different degrees of stability makes us ex- 
pect that noise is relevant to the choice of the attractor the GCM settles to. 
One might then suspect that such Milnor attractors must be weak against 
noise. Indeed, by a very weak noise with the amplitude a, an orbit at a 
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Milnor attractor is kicked away, and if the orbit is reached to one of attrac- 
tors with o c > a, it never comes back to the Milnor attractor. In spite of 
this instability, however, an orbit kicked out from a Milnor attractor is often 
found to stay in the vicinity of it, under a relatively large noise[10]. The orbit 
comes back to the original Milnor attractor before it is kicked away to other 
attractors with a c > a. Furthermore, by a larger noise, orbits sometimes 
are more attracted to Milnor attractors. Such attraction is possible, since 
Milnor attractors here have global attraction in the phase space, in spite of 
their local instability. 

3 Magic Number 7±2 in Dynamical Systems? 

Milnor attractors can exist in low dimensional dynamical systems like a two- 
dimensional map as well. When changing the parameter of a dynamical 
system, the basin boundary of an attractor may move until, for a specific 
value of the parameter, the basin boundary touches the attractor. Then, if 
the attractor has a positive measure of initial conditions forming the basin of 
attraction, it becomes a Milnor attractor. Generally speaking, however, the 
above situation occurs only for very specific parameter values, and it is not 
naively expected that the Milnor attractors exist with a positive measure in 
the parameter space. 

However, as was shown in the last section, Milnor attractors are found 
to be rather prevalent, occurring not only for specific isolated parameter val- 
ues. Such dominance of Milnor attractors is often found in high-dimensional 
dynamical systems, for example coupled maps with 10 degrees of freedom or 
so. Then, the question we address now is why can there be so many Milnor 
attractors in a "high-dimensional" dynamical system, and what number of 
degrees of freedom is sufficient for constituting such 'high' dimensionality. 

We computed the average basin fraction of Milnor attractors over the 
parameter interval 1.55 < a < 1.72. In Fig. 3, this fraction is plotted as a 
function of the number of degrees of freedom N. The increase of the average 
basin fraction of Milnor attractors with N is clearly visible for N ~ (5 ~ 10), 
while it levels off for N > 10. Indeed, such increase of Milnor attractors with 
the degrees of freedom 5 ~ 10 seems to be universal in a partially ordered 
phase in globally coupled chaotic system [16]. (Here, the degree of freedoms 
we use in the present paper is the number of units that has orbital instability. 
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Figure 3: The average fraction of the basin ratio of Milnor attractors. After 
the basin fraction of Milnor attractor is computed as in Fig.l, the average of 
the ratios for parameter values a = 1.550, 1.552, 1.554, • • • 1.72 is taken. This 
average fraction is plotted as a function of N. (In this class of models, the 
fraction of Milnor attractors is larger for odd N than for even N. Note that 
two clusters with equal cluster numbers and anti-phase oscillations generally 
have less chaotic instability. A globally coupled map with an even number of 
elements allows for equal partition into two clusters. This gives a plausible 
explanation for the smaller instability for even N system.) 

For example, if we choose a coupled system of N Lorenz equations, the 
degrees we mention is not 3iV, but N.) 

Now we discuss a possible reason how the dominance of Milnor attractors 
appears. In a system with identical elements, due to the symmetry, there are 
at least M(N 1: N 2 , ■ ■ ■ , N k ) = u k Nl n ov ersetsofN i =N j attractors for each 

clustering condition, where rri£ is the number of clusters with the same value 
Nj. Then, a combinatorial explosion in the number of attractors can be 
expected when many of the clustering conditions are allowed as attractors. 
For example, the permutation of N elements leads to (N — 1)! possibilities 
and one might expect the number of attractors to be of this order. On 
the other hand, the phase space volume in a coupled system expands only 
exponentially with N. Typically the combinatorial explosion outruns the 
exponential increase around iV (5 ~ 10). (For example compare 2^ and 
(N — 1)!. The latter surpasses the former at N = 6.) Hence, the attractors 
crowd[17] in the phase space and the stability of each attractor may be lost. 
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However, this argument seems to be incorrect. We have computed the 
number of attractors and compared with the basin fraction of Milnor attrac- 
tors. As has been shown [16], the dominance of the Milnor attractors is not 
necessarily observed when the number of attractors is high. With increasing 
a, the fraction remains large even when the number of attractors has already 
decreased substantially. Since the basin volume of each of the attractors is 
far from being equal, the explosion in the number of attractors does not nec- 
essarily mean that the basin volume for each and every attractor should be 
very small. Indeed, according to our numerical results, for the parameter re- 
gion where the Milnor attractors dominate, the number of Milnor attractors 
is not so high and the basin fraction of only a few Milnor attractors occupies 
almost all of phase space. 

In the above sequence, the dominance of the Milnor attractors is observed 
when many attractors have disappeared. Therefore, we can revise the first 
explanation on the dominance by replacing the combinatorial explosion in 
the number of attractors themselves by the combinatorial explosion in the 
number of basin boundaries that separate the attractors. For the param- 
eter region where many attractors start to disappear, there remain basin 
boundary points separating such (collapsed) attractors and the remaining 
attractors. 

Now, we need to discuss how the distance between an attractor and its 
basin boundary changes with N. Consider a one-dimensional phase space, 
and a basin boundary that separates the regions of x(l) > x* and x(l) < x*, 
while the attractor in concern exists at around x(l) = xa < x*, and the 
neighboring one at around x(l) = Xb > x*. Now consider a region of N- 
dimensional phase space xa < x(i) < xb- If the region is partitioned by 
(basin) boundaries at x(i) = x* for i = 1, • • • N, it is partitioned into 2^ 
units. Since this partition is just a direct product of the original partition 
by x(l) = x*, the distance between each attractor and the basin boundary 
does not change with N. (For example, consider the extreme case that iV 
identical maps are uncoupled (e = 0).) 

On the other hand, consider a boundary given by some condition for 
(x(l), • • • , x(N)), represented by a (possibly very complex) hyperplane C(x(l), • • • , x(N)) = 
0. In the present system with global (all-to-all) couplings, many of the per- 
mutational changes of x(i) in the condition also give basin boundaries. Gen- 
erally, the condition for the basin can also have clustering (Ni, • • • , N^), since 
the attractors are clustered as such. Then the condition obtained by the per- 
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mutation of C(x(l), ■ ■ ■ ,x(N)) = gives a basin boundary also (or one can 
say that C(x(l), • • • ,x(N)) = itself satisfies such permutational symme- 
try). Then, the basin boundary has M(N 1 ,- ■ • ,N k ) segments transformed 
into each other by the permutations. The number of such segments of the 
boundaries increases combinatorially with N. Roughly speaking, the sum of 
M(Ni, • • • , Nk) increases in the order of (N—l)\, when a variety of clusterings 
is allowed for the boundary. Now the iV-dimensional phase space region is 
partitioned by 0(N — 1)!) basin boundary segments. Recalling that the dis- 
tance between an attractor and the basin boundary remains at the same order 
for the partition of the order of 2 N , the distance should decrease if (N — 1)! 
is larger than 2 N . Since for N > 5, the former increases drastically faster 
than the latter, the distance should decrease drastically for iV > 5. Then 
for iV > 5, the probability that a basin boundary touches with an attractor 
itself will be increased. Since this argument is applied for any attractors and 
their basin boundary characterized by complex clusterings having combina- 
torially large M(N\, ■ ■ ■ , Nk), the probability that an attractor touches its 
basin boundary is drastically amplified for N > 5. Although this explana- 
tion may be rather rough, it gives a hint to why Milnor attractors are so 
dominant for N « (5 ~ 10). We surmise that this is the reason why Milnor 

attractors are dominant in our model at (1.64 ~ 1.67) when TV « (5 ~ 10). 

Since the above discussion is based mainly on simple combinatorial argu- 
ments, it is expected that the dominance of Milnor attractors for N ps (5 ~ 
10) may be rather common at some parameter region in high dimensional 
dynamical systems. It is interesting that pulse-coupled oscillators with global 
coupling also show the prevalence of Milnor attractors for N > 5 [18]. 

One might expect that permutational symmetry us necessary for the 
prevalence of Milnor attractors. For example, in the GCM (1), the per- 
mutation symmetry arising from identical elements leads to a combinatorial 
explosion in the number of attractors. Then, one may wonder whether the 
prevalence of Milnor attractors is possible only for such highly symmetric 
systems. We have therefore studied a GCM with heterogeneous parameters. 
Although the fraction seems to be smaller than in the homogeneous case, 
Milnor attractors are again observed and their basin volume is rather large 
for some parameter region. As in the symmetric case, the basin fraction of 
Milnor attractors increases around N « (5 ~ 10). 

Note that even though complete synchronization between two elements is 
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lost, clusterings as with regards to the phase relationships can exist. (As for 
such phase synchronization of chaotic elements see [19]). Indeed, there are 
two groups when considering the oscillations of phases as large-small-large... 
and small-large-small..., that are preserved in time for many attractors. Fur- 
thermore, finer preserved phase relationships can also exist. Similarly, it is 
natural to expect an explosion in the number of the basin boundary points 
for some parameter regime. Accordingly the argument on the dominance 
of Milnor attractors for a homogeneous GCM can be applied here to some 
degree as well. 

It is also interesting to note that in Hamiltonian dynamical systems, 
agreement with thermodynamic behavior is often observed only for degrees 
of freedom higher than 5 ~ 10 [20]. Considering the combinatorial complexity 
woven by all the possible Arnold webs (that hence may be termed "Arnold 
spaghetti"), the entire phase space volume that expands only exponentially 
with the number of degrees of freedom may be covered by webs, resulting 
in uniformly chaotic behavior. If this argument holds, the degrees of free- 
dom required for thermodynamic behavior can also be discussed in a similar 
manner. 

4 Chaotic Itinerancy 

In the PO phase, orbits often make itinerancy over several ordered states 
with partial synchronization of elements, through highly chaotic states. This 
dynamics, called chaotic itinerancy (CI), is a novel universal class in high- 
dimensional dynamical systems[21]. In the CI, an orbit successively itinerates 
over such "attractor-ruins" , ordered motion with some coherence among el- 
ements. The motion at "attractor-ruins" is quasi- stationary. For example, 
if the effective degrees of freedom is two, the elements split into two groups, 
in each of which elements oscillate almost coherently. The system is in the 
vicinity of a two-clustered state, which, however, is not a stable attractor, but 
keeps attraction to its vicinity globally within the phase space. After stay- 
ing at an attractor-ruin, an orbit eventually exits from it. This exit arises 
from orbital instability. In the above example, the synchronization among 
the two groups is increased. Then, as is straightforwardly seen in the model 
equation (1), the dynamics are approximately given by rc n+1 = f(x n ), which 
has stronger orbital instability than a clustered state. With this instability 
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the state enters into a high- dimensional chaotic motion without clear coher- 
ence. (Here it is interesting to note that the effective degrees of freedom 
decreases before it goes to a high-dimensional state). This high-dimensional 
state is again quasi- stationary, although there are some holes connecting to 
the attractor-ruins from it. Once the orbit is trapped at a hole, it is suddenly 
attracted to one of attractor ruins, i.e., ordered states with low-dimensional 
dynamics. 

This CI dynamics has independently been found in a model of neural 
dynamics by Tsuda [22], optical turbulence [23], and in GCM[3, 24]. It 
provides an example of successive changes of relationships among elements. 

There seem to be several types of "chaotic itinerancy" covered by this 
general definition for it. It can roughly be classified according to the degree 
of correlation between the ordered states visited successively. The correlation 
is high if the paths for the transitions between the ordered states are narrow, 
and the probabilities for visiting the next ordered state are rather low. On 
the other hand, the correlation is low when the memory of the previous sate 
is lost due to high-dimensional chaos during the transition. 

Still, the systems with chaotic itinerancy studied so far commonly have 
a small number of positive Lyapunov exponents and many exponents close 
to zero. As a result, the dimension of the global attractor is high, while the 
path in the phase space is restricted. 

Note that the Milnor attractors satisfy the condition of the above or- 
dered states constituting chaotic itinerancy. Some Milnor attractors we have 
found keep global attraction, which is consistent with the observation that 
the attraction to ordered states in chaotic itinerancy occurs globally from a 
high-dimensional chaotic state. Attraction of an orbit to precisely a given 
attractor requires infinite time, and before the orbit is really settled to a 
given Milnor attractor, it may be kicked away. Then, the long-term dynam- 
ics can be constructed as the successive alternations to the attraction to, 
and escapes from, Milnor attractors. If the attraction to robust attractors 
from a given Milnor attractor is not possible, the long-term dynamics with 
the noise strength — > +0 is represented by successive transitions over Mil- 
nor attractors. Then the dynamics is represented by transition matrix over 
among Milnor attractors. This matrix is generally asymmetric: often, there 
is a connection from a Milnor attractor A to a Milnor attractor B, but not 
from B to A. The total dynamics is represented by the motion over a net- 
work, given by a set of directed graphs over Milnor attractors. In general, 
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the 'ordered states' in CI may not be exactly Milnor attractors but can be 
weakly destabilized states from Milnor attractors. Still, the attribution of CI 
to Milnor attractor network dynamics is expected to work as one ideal limit. 
remark 

Computability of chaotic itinerancy has a serious problem, since switching 
process over Milnor attractor network in the noiseless case may differ from 
that of the case with the limit of noise — > +0, or from that obtained by 
a digital computer with a finite precision. For example, once the digits of 
two variable x(i) = x(j) agree down to the lowest bit, the values never split 
again, even though the state with the synchronization of the two elements 
may be unstable[25] . As long as digital computation is adopted, it is always 
possible that an orbit is trapped to such unstable state. (See [26], for one 
technique to resolve this numerical problem). 

In each event of switching, which Milnor attractor is visited next after 
the departure from a Milnor attractor may depend on the precision, or on 
any small amount of noise. Here it may be interesting to note that there 
are similar statistical features between (Milnor attractor) dynamics with a 
riddled basin and undecidable dynamics of a universal Turing-machine [2 7]. 

5 Relevance to Neural Networks 

When one considers (static) memory in terms of dynamical systems, it is 
often adopted that each memory is assigned into an attractor. Here, a system 
with many attractors is desirable as such system. Then, existence of Milnor 
attractors may lead us to suspect the correspondence between a (robust) 
attractor and memory. 

Here, it may be interesting to recall that the term magic number 7±2 was 
originally coined in psychology [28]. It was found that the number of chunks 
(items) that is memorized in short term memory is limited to 7 ± 2. Indeed 
with this number 7 ±2, the fraction of basins for Milnor attractors increases. 
Since possible explanation is based only on combinatorial arguments, this 
'magic number 5 ~ 10' in dynamical systems does not strongly depend on 
the choice of specific models. Then, it may be interesting to discuss a possible 
connection of it with the original magic number 7±2 in psychology, (see also 
[29] for a pioneering approach to this problem from a viewpoint of chaotic 
dynamics). To memorize k chunks of information including their order (e.g., 
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a phone number of k digits) within a dynamical system, it is natural to assign 
each memorized state to an attractor of a /c-dimensional dynamical system 
(unless rather elaborate mechanisms are assumed). In this k dimensional 
phase space, a combinatorial variety of attractors has to be presumed in 
order to assure a sufficient variety of memories. Then, if our argument so far 
is applied to the system, Milnor attractors may be dominant for k > (5 ~ 10). 
If this is the case, the state represented by a Milnor attractor may be kicked 
out by tiny perturbations. Thus robust memory may not be possible for 
information that contains more than 7±2 chunks. Possibly, this argument can 
also be applied to other systems that adopt attractors as memory, including 
most neural networks. 

(Of course, the present argument should mainly be applied to systems 
with all-to-all couplings, or to highly connected network systems. If the 
connections are hierarchically ordered, the number of memory items can be 
increased. The often adopted module structure is relevant for this purpose.) 

This argument does not necessarily imply that Milnor attractors are irrel- 
evant to cognitive processes. For a dynamical system to work as a memory, 
some mechanism to write down and read it out is necessary. If the memory is 
given in a robust attractor, its information processing is not so easy, instead 
of its stability. Milnor attractors may provide dynamic memory [22, 1] al- 
lowing for interface between outside and inside, external inputs and internal 
representation. In a Milnor attractor, some structure is preserved, while it is 
dynamically connected with different attractors. Also, it can be switched to 
different memory by any small inputs. The connection to other attractors is 
neither one-to-one nor random. It is highly structured with some constraints. 

Searches with chaos itinerating over attractor ruins has been discussed 
in [30, 22] with a support in an experiment on the olfactory bulb [30]. Freeman, 
through his experiments, proposed that the chaotic dynamics corresponds to 
a searching state for a variety of memories, represented by attractors [30], 
while evidence from human scalp EEG showing chaotic itinerancy is also 
suggested[31]. 

We note that the Milnor attractors in our GCM model provide a candidate 
for such a searching state, because of connection to a variety of stronger 
attractors which possibly play the role of rigidly memorized states. Stability 
of Milnor attractors by some noisy inputs also supports this correspondence. 
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